Papers with human writing process
From Model-centered to Human-Centered: Revision Distance as a Metric for Text Evaluation in LLMs-based Applications (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation metrics for large language models yield numerical scores that ignore user experience. |
| Approach: | They propose a metric that suggests revision edits that mimic the human writing process . their results show that the metric offers more insightful feedback and distinguishes between texts . |
| Outcome: | The proposed metric can provide a self-explained text evaluation result in a human-understandable manner beyond the context-independent score. |
ScholaWrite: A Dataset of End-to-End Scholarly Writing (2026.acl-long)
Copied to clipboard
| Challenge: | SCHOLAWRITE traces the multi-month journey from initial drafts to final manuscripts . authors demonstrate the value of capturing scientists’ cognitive writing process . |
| Approach: | They present a dataset of end-to-end scholarly writing tracing the multi-month journey from initial drafts to final manuscripts. |
| Outcome: | The first dataset of end-to-end scholarly writing traces the multi-month journey from initial drafts to final manuscripts over four months. |